Vision-language models (VLMs) have achieved strong results on coding and math benchmarks that are challenging for humans, yet their ability to perform tasks that come naturally to humans--such as perception, spatial navigation, and memory management--remains understudied. Real video games are crafted to be intuitive for humans to learn and master by leveraging innate inductive biases, making them an ideal testbed for evaluating such capabilities in VLMs. To this end, we introduce VideoGameBench, a benchmark consisting of 10 popular video games from the 1990s that VLMs directly interact with in real-time. VideoGameBench challenges models to complete entire games with access to only raw visual inputs and a high-level description of objectives and controls, a significant departure from existing setups that rely on game-specific scaffolding and auxiliary information. We keep three of the games secret to encourage solutions that generalize to unseen environments. Our experiments show that frontier vision-language models struggle to progress beyond the beginning of each game. We find inference latency to be a major limitation of frontier models in the real-time setting; therefore, we introduce VideoGameBench Lite, a setting where the game pauses while waiting for the LM's next action. The best performing model, Gemini 2.5 Pro, completes only 0.48% of VideoGameBench and 1.6% of VideoGameBench Lite. We hope that the formalization of the human skills mentioned above into this benchmark motivates progress in these research directions.

Blender 3D provides all the features you need to create super-realistic 3D models of machines for use in artwork, movies, and computer games. Blender 3D 2.49 Incredible Machines gives you step-by-step instructions for building weapons, vehicles, robots, and more. This book will show you how to use Blender 3D for mechanical modeling and product visualization. Through the pages of the book, you will find a step-by-step guide to create three different projects: a fantasy weapon, a spacecraft, and a giant robot. Even though these machines are not realistic, you will be able to build your own sensible and incredible machines with the techniques that you will learn in this book along with the exercises and examples.